By the end of Madison's second term, he was a popular figure. He retired from public life. The year was 1817. Like Jefferson, slavery was a paradox for Madison and a personal burden. Madison owned a plantation  requiring intense  manual   labor, and that labor was provided by slaves. But in principle, he was against slavery. And, like Jefferson, after a long life of accomplishments, Madison looked to the future and saw a nation in trouble.